Search AI Products and News

The rapid advancement of generative AI technology has revolutionized digital content creation, but bias remains a persistent issue. A recent investigation by Wired magazine into OpenAI's video generation tool, Sora, revealed that the tool frequently reinforces stereotypes related to race, gender, and ability, sometimes even neglecting the representation of certain groups. Image Note: Image generated by AI, image licensed by Midjourney. In the investigation, researchers provided S...

Recently, OpenAI's research team discovered that the usernames chosen by users can somewhat influence the responses of ChatGPT during interactions. Although this effect is relatively minor and primarily seen in older models, the findings are still noteworthy. Users typically provide their names to ChatGPT for tasks, making the cultural, gender, and racial backgrounds inherent in those names an important factor in studying bias. In this research, the researchers explored ChatGPT.

Black founders have noticed that mainstream large language models like ChatGPT have significant shortcomings in addressing cultural differences. These models often provide overly generic responses to questions unrelated to a Western cultural context, lacking an understanding of African Americans and their unique cultural traditions.

Anthropic has successfully reduced AI bias by adopting a request strategy that emphasizes friendly treatment in prompts, achieving significant results. Researchers informed the model to avoid bias by incorporating 'intervention' into the prompts, successfully bringing bias down to almost zero. The strategy highlights the need for cautious language model use in high-risk decision-making, influenced by government and societal factors. Anthropic is collaborating with Google to deploy Google's Cloud TPUv5e chips to support its language model, Claude. This research provides new strategies for reducing AI bias.